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Abstract 

We develop an information-theoretic perspective on some questions in convex ge- 
ometry, providing for instance a new equipartition property for log-concave probability 
measures, some Gaussian comparison results for log-concave measures, an entropic for- 
mulation of the hyperplane conjecture, and a new reverse entropy power inequality for 
log-concave measures analogous to V. Milman's reverse Brunn-Minkowski inequality. 

1 Introduction 

This Note announces some of the results obtained in El [9]. Given a random vector X 
in R n with density f(x), the entropy power is defined by Af(X) = e 2h ( x )/ n ^ where, with a 
common abuse of notation, we write h{X) for the Shannon entropy h{f) := — J Rn / log/. 

Theorem 1.1. If X andY are independent random vectors inM. n with log-concave densities, 
there exist affine entropy-preserving maps Ui : W l — > M. n such that 

N{X + Y) < C(X(X)+Af(Y)), 
where X = u\{X), Y = U2(Y), and where C is a universal constant. 

Observe that the Shannon-Stam entropy power inequality |24j implies that Af(X + Y) > 
Af(X) + Af(Y) is always true. Thus Theorem 11.11 may be seen as a reverse entropy power 
inequality for log-concave measures. The proof of this assertion, outlined in Section 3, is 
based on a series of propositions introduced in Section 2 including V. Milman's result on the 
existence of M-ellipsoids. Specializing to uniform distributions on convex bodies, we show 
that Theorem 11.11 recovers Milman's reverse Brunn-Minkowski inequality |19j . One may also 
think of Theorem 11.11 as completing the usual analogy between the Brunn-Minkowski and 
entropy power inequalities (see, e.g., [14]). 

This Note is in the nature of a sketch meant as an entry point for the interested reader into 
the recent work by the authors in 0[8l[9]. Therefore, details are kept to a minimum. However, 
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it is appropriate to mention that the tools relied upon in our proof of Theorem 11.11 and allied 
results (some of which are not detailed in the sequel) include the localization lemma of 
Lovasz-Simonovits [T7], reverse Holder type inequalities such as Berwald's inequality [^1 HUj. 
the studies of the hyperplane conjecture by Bourgain [13], Milman-Pajor [22], and Ball [H[2], 
a submodularity property for the entropy of sums developed by the second-named author 
|18| . and ideas from the literature on convex measures and isoperimetry developed by Borell 
[HI [12] and the first-named author [5l [6] . 

2 Intermediate results 
2.1 An equipartition property 

Let X be a random vector taking values in W 1 , and suppose its distribution has a density / 
with respect to Lebesgue measure on M. n . The random variable h{X) = — \ogf{X) may be 
thought of as the "information content" of X. Note that the entropy is h(X) = ~Eh(X). 

Because of the relevance of the information content in information theory, probability, and 
statistics, it is intrinsically interesting to understand its behavior. In particular, a natural 
question arises: Is it true that the information content concentrates around the entropy in 
high dimension? In general, there is no reason for such a concentration property to hold. 
However, the following proposition shows that in fact, such a property holds uniformly for 
the entire class of log-concave densities. 

Theorem 2.1. If X has a log-concave density f on W 1 , then for < e < 2, 

r {h(X) hjX) 
\ n n 

No normalization whatsoever is required for this result, which is proved in [7] using the 
localization lemma of Lovasz-Simonovits, and certain reverse Holder type inequalities for 
log-concave measures. 

Equivalently, with high probability, f{x) 2 l n is very close to the entropy power N(X) = 
exp{^ h(X)}, and the distribution of X itself is effectively the uniform distribution on the 
class of typical observables, or the "typical set" (defined to be the collection of all points 
x € M. n such that f(x) lies between e -K x )- ne anc i e —h(X)+ne ^ f or some sma n fixed e > 0). 
The effective uniformity of the distribution of X on some compact set, entailed by this 
concentration result, may be seen as an extension of the asymptotic equipartition property 
(or Shannon-McMillan-Breiman theorem) to non-stationary stochastic processes with log- 
concave marginals (cf. [7]). 

If one is more interested in the effective support rather than an effective uniformity, one 
can simply consider a superlevel set (necessarily convex and compact) of the density / instead 
of the annular region above. This effective support on a convex set implied by Theorem 12.11 
allows (see [9]) the transference of some results from the setting of convex bodies to that of 
log-concave measures, in particular, the existence of M-ellipsoids [191 Ell EQl [23] • (Such a 
transference technique based on looking at superlevel sets of log-concave densities has been 
anticipated before, e.g., by [16] . but Theorem 12.11 refines those observations and identifies the 
underlying concentration phenomenon.) 

Corollary 2.2. Let /i be a probability measure on R n with log-concave density f such that 
ll/lloo > 1 (where ||/||oo is the essential supremum and hence the maximum of f). Then 



> e > < 4e~ 
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there exists an ellipsoid £ of volume 1 such that ^(S) 1 ^ > cm for some universal constant 
cm £ (0,1). 

Equivalently, for some linear volume-preserving map u : R n — > R n , fj 1 u~ 1 (D) 1 ^ n > cm, 
where D is the Euclidean ball of volume one. 

2.2 Entropy and the maximal density value 

Trivially h(X) > log H/H^, 1 . In fact, one can also bound the entropy from above using the 
maximal density value under log-concavity (see [8]). 

Theorem 2.3. If a random vector X in R" has log-concave density f , then 

log \\ftJ /n <~h(X) < 1 + log ll/ll" 1 /™. 
n 

The hyperplane conjecture or slicing problem (cf. Bourgain [IJr or Ball [2j) asserts that 
there exists a universal, positive constant c (not depending on n) such that for any convex 
set K of unit volume in K n , there exists a hyperplane H passing through its centroid such 
that the (n — l)-dimensional volume of the section K n H is bounded below by c. There 
are several equivalent formulations of the conjecture, all of a geometric or functional analytic 
flavor (even the ones that nominally use probability). The current best bound known, due 
to Klartag [T5], is 0(n -1 / 4 ). Theorem O gives a purely information-theoretic formulation of 
the hyperplane conjecture. For a random vector X in M. n with density /, let D(X) or D(f) 
denote its relative entropy from Gaussianity (which is the relative entropy from the Gaussian 
g with the same mean and covariance matrix, and also equals the difference h(g) — h{f)). 
The Entropic Form of the Hyperplane Conjecture asserts that for any log-concave density 
/ on M. n , D(f) < cn for some universal constant c. It is easy to see then that another 
equivalent form of the hyperplane conjecture is that the entropic distance from independence 
(i.e., the relative entropy of any log-concave measure from the product of its marginals) is 
also bounded by cn for some universal constant c. As an aside, Klartag's result combined 
with our equivalence implies that D(f) < \n log n + cn for any log-concave /. This is already 
the first quantitative demonstration of the spiritual closeness of log-concave measures to 
Gaussians, which has been observed in qualitative ways numerous times (e.g., behavior as 
regards functional inequalities). Let us note en passant that entropy plays a role in Ball's [3] 
proof that the KLS conjecture implies the hyperplane conjecture. 

3 Proof outline of Theorem 11.11 

The following "submodularity" property of the entropy functional with respect to convolu- 
tions was obtained in [18]: Given independent random vectors X, Y, Z in R n with absolutely 
continuous distributions, we have 

h(X + Y + Z) + h(Z) < h(X + Z) + h(Y + Z) 

provided that all entropies are well-defined. 

Let Z ~ Unif(D), where D is the centered Euclidean ball with volume one. Since h(Z) = 
0, the submodularity property implies 

h(X + Y) <h(X + Y + Z) < h(X + Z) + h(Y + Z), 
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for random vectors X and Y in R n independent of each other and of Z. 

Let X and Y have log-concave densities. Due to homogeneity of Theorem 11.11 assume 
without loss of generality that |[/||oo — 1 an d ||<?||oo — 1- Then, our task reduces to showing 
that both N(X + Z) and J\f(Y + Z) can be bounded from above by universal constants. 

By Corollary 12.21 f° r some affine volume preserving map u : R n — > R n , the distribution 
p, of X = u(X) satisfies ^(D) 1 ^ > cm with a universal constant cm > 0. Let / denote the 
density of X = u(X). Then the density p of 5 = X + Z, given by p{x) = j D f(x — z) dz = 
jl(D — x), satisfies ||p|| > p(0) > c M . Applying Theorem 12.31 to the random vector S, 

J\f(S) < C ||p||oo 2 ^ ra < C ■ cj_f, which completes the proof. 

Remark 1. Recall C. Borell's hierarchy of convex measures on R n , classified by a parameter 
k € [— oo,l/n]. In this hierarchy, k = corresponds to the class of log-concave measures. 
When k > 0, a K-concave probability measure is necessarily compactly supported on some 
convex set. 

For any random vector X with values in A, there is a general upper bound h(X) < log \ A\. 
Using Berwald's inequality, we provide a complementary estimate from below depending only 
on the "strength" of convexity of the density / of X: Let X be a random vector in R™ 
having an absolutely continuous k- concave distribution supported on a convex body A with 
< k < 1/n. Then h(X) > log \A\ + nlog(«;n). Note when k = 1/n, this bound is sharp. 

Assume a probability measure \i is ^'-concave on R n and a probability measure v is 
^/'-concave on R™. If k',k" € [—1, 1] satisfy 

/ // 111 , . 

k' + k">0, - = - + — 3.1 

K K K 

then their convolution [i*v is «;-concave. Hence, if random vectors X± and X<i are independent 
and uniformly distributed in convex bodies A\ and A2 in R n , then the sum X\ + Xi has 
a ^-concave distribution supported on the convex body A\ + A%. The preceding entropy 
bound then implies that h{X\ + X2) > log \ A\ + A2I — nlog2. This immediately allows one 
to deduce Milman's reverse Brunn-Minkowski inequality from Theorem ll.il 

Remark 2. Theorems 1 1.1 1 and 12 .31 have been extended to the larger class of convex measures 

mi. 

Remark 3. It is instructive to write some of the above observations as entropy comparison 
results. For example, the bound in Remark 1 says that if / is a density of the random vector 
X taking values in the convex body A, and if is the uniform distribution on A, 

< -D{f\\\] A ) = -h(\J A )--h(X) < C. 
n n n 

where D(f\\g) = J /(x)log^y dx is the relative entropy. In this form, the constant upper 
bound on the difference between relative entropies per coordinate expresses a dimension-free 
approximation of the distribution of X by the uniform distribution IL4. On the other hand, 
Theorem 12.31 can be rewritten as saying that if Z in IR n is any normally distributed random 
vector with maximum density being the same as that of X, then 

-h(Z) - i < - h(X) < -h(Z) + i 

This is a dimension-free approximation of the entropy of X by a Gaussian entropy. The 
entropic formulation of the hyperplane conjecture described in Section 2 is another such 
dimension- free approximation, both of entropy and distributional (see [8] for details). 
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